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THREE RELATED PROGRAMS FOR RETRIEVAL, 
PROGRAMMED. TEACHING, ‘AND THE TAKING OF NOTES 


This is a hurried sketch of three closely related 
types of programs that I think should be written, in at 
least crude form, for high-speed machines with tape drives 
and some sort of on-line output and input. For logical 
Simplicity I will assume the use of a simple machine (e.g., 
the Packard Bell 250) with a typewriter for both output 
and input and a couple of magnetic tape drives. However, 
it should be evident that economies of scale for some of 
the functions mentioned below will not appear until lar- 
ger machines can service many stations. 


1. "N-category" revisable cataloguing systems, especially 
for information retrieval. 


These systems use machines for sorting, but accord- 


ing to principles that are conceptually different from 


sorting in the usual sense. By n-category tagging I mean 
that an item (such as the title of an article can be 
coded as being in or out of any number of categories, and 
a_new category can be added at any time. A record is kept 
of all the categories an item is definitely in or out of. 
However, a decision does not have to be made as to whether 
a given item is in a given category. 


New items may, of course, be filed and checked by 
a coder as being in or-out of some range of the categories 
in storage. The categories may have titles, but the titles 
can be changed on examination of the items in the categor- 
les. Moreover, new 'purified! categories may be made from 
Old ones. That is, new categories are set up which con- 
tain only some of the contents of the previous ones. 


Items can be recoded from time to time. 


Searches can be requested; the machine will then 
present a list or a count of the contents of a category, 
or of the things ¢onjunctly or disjointly in several Gate- 
gories, or all items being in at least a certain number of 
categories from a given list, etc. 


ry 
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Inventory provisions: The number of things on 
file and various counts of the distributionof their cate- 
gory tags, can be made automatically. Moreover, a history 
of the file, including inputs and changes, permits the re- 
turn to any previous state which was better. 


In some systems it may be desirable to store entire 
books and articles on magnetic tape, and feed them out to 
the user as required. While this is not critical to the 
philosophy of categories here, it is assumed later in the 
paper. 


Discussion. 


The paramount fact to me is that categories change 

- in their meaning. Partly because there are subtle shifts 
in the semantics of category titles, partly because the 
subject matter changes in time or comes to be looked at 
differently, partly because the items within a category 
may turn out to have autonomous properties of their own 
that were not anticipated, it is a mistake to expect cate- 
gories, especially important ones, to be stable. 


In this respect I take the "keyword" principle, as 
currently used in IR theory, to be spurious. The fact that 
words are selected as 'objective' criteria of the categories 
to sort things in is misleading. "It usually takes a highly- 
skilled person to select keywords in a document..." (IBM, 

"An Introduction to Information Retrieval," (%.10). hab is, 
the keywords are only part of the criteria by which they 

are assigned to categories, and their objectivity provides 
only hints for their categorization (or in the extreme case, 
excuses). Although many categories remain stable and recog- 
nizable by the same keywords, a crucial fraction are always 
in conceptual change. Are not these the ones for which re- 
trieval is the biggest problem? 


2. Easy-load-format n-pathway teaching programs. 


Lay This program operates on materials already on 
iD tape, i.e., books and articles which are in the machine 

' already. The Proprietor of the program selects sections | 
of the material which he wants shown to students, and de- 
cides on possible 'pathways! through the material. That 
is, a student may proceed in linear fashion, seeing one 
thing after another, not having to respond. 
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The Proprietor may also add interpolated items-- 
for instance, questions and corinective material--that 
were not previously on file. He may also put in branch- 
ings--items which ask the student a question, or request 
him to state his preference. ‘Tite student's response will 
determine, according to the previous instructions of the 
Proprietor, what materials he will see subsequently. 


Note that the usual linear sequence is by no means 
the only one possible. In the linear sequence the stu- 
dent sees item A, gives a response, and then sees Al, A2, 
...An, or (in the case of a correct answer) B. He will 
never see C unless he sees B first. In this general pro- 
gram such a convention is strictly the option of the Pro- 
prietor. By "n pathways" I mean it would be possible to 
add conditional pathways indefinitely. 


Discussion. 


Programmed teaching today is focussed on finding 
highly efficient items to teach certain very specific 
things to a target population. Whether this is the proper 
approach depends on some very important assumptions, for 
instance, the costs of using inefficient items (in terms 
of time wasted and mis-learning), in comparison with the 
enormous cost of weeding out the inefficient items. 


The alternative described here--the easy-load, 
multiple-pathway pream--has these advantages: it can be 
quickly programmed ad hoc in a particular subject for a 
small population, e.g., a small class taking a specialized 
course; such a program need bg no more complicated than a 
reading list, but indéfinitely more flexible because it can 
be. specially branched for a student's misunderstandings 
and interests. Furthermore, it can be easily updated, 
improved or revised as its proprietor sees the need. 


Low efficiency of first-attempt loading (compared 
to professional Hagh-cost teaching programs) is offset by 
the great diversity, variety, and cheapness of them, and 
with their vast adaptation to the students. 
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3. Programs for taking notes on written material. 


Supposing that someone is reading material pre- 
sented him by the computer, as in (1), he,may type in 
notes for his own future benefiy which are stored on 
his own tape, and request the storage of certain parts 
of the original in his own notes--for his own future use 
as quotations in S$ own writing, or to remind him of 


the contents of what he read. 


The materials may then be arranged by the user 
in "n categories" (by system 1), or in alternative sets 
of 7 maa that he may later go back through (by sys- 
tem 2). 


Discussion. This would be of use to a student 
at any level, aS an economical means of summarizing 
what he has read, and condensing it for review and em- 
phasis. Advanced researchers could quickly excerpt key 
passages and quotations. 


GENERAL REMARKS 


I see information retrieval (which is really 
the category problem), programmed learning and the or- 
ganization of notes as three elements of a united whole. 


Information retrieval at most levels involves 
showing somebody something he doesn't know, even if hacits 
an advanced professional in his field. There is no reason 
why the authors of professional articles might not pre- 
pare their materials in multiple-pathway form, to depend 
on the interests and knowledge of the reader--much as they 
now prepare summaries without complaint. Or this could be 
done by editors. 


The growing capacities of machine storage permit 
repository libraries to be founded where researchers may 
place fringe materials in one way or another unsuitable 
for journal publication. Similarly, they would also per- 
mit the storage of unusual teaching programs--peculiar 
materials, or peculiar treatments, or aimed at peculiar 
populations--for instance, Hopi Indians wishing to study 
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nuclear physics (for which, it is rumored, they have a 
special aptitude.) In previous times such material was 
far more perishable, and perhaps would,never be attempted 
because it could never be foupe again. Today it.seems 
increasingly possible that sash*things could be found again. 


This combination of interwoven systems would have 
the advantage that one running it could be programmed 
immediately for use in any field of knowledge without fear 
of obsolescence because of the updating features. (The 
problems of charts, illustrations and mathematical symbols 
are ignored here.) 


Furthermore, the possible variety of such instruc- 
tion programs would probably have a tremendous impact on 
certain problems in education where misunderstandings, im- 
patience and anxieties are high, such as the teaching of 
mathematics to people who have shied away from it. As a 
rule teachers of mathematics cannot fathom the impact that 
the failure to understand will have on a student, say, of 
literature, who has built so much of his career on his abil- 
ity to achieve immediate insight. Such programs, put to- 
gether experimentally by people here and there and elabor- 
ated by others, would find gradually what approaches work. 


Hence the emphasis here is evolutionary. The 
idea is to get the programs working and watch them improve, 
rather than do intense research for a year before putting 


one finished program on the market. 


A combination of them--which seems 'ultimate,' at 
least in 1962--would permit the automation of libraries 
and the whole process of study, if not of teaching. Ha 
cannot help thinking that this is a “great leap? which 
the underdeveloped countries could make. : 


ene 
b. fukn 
5 Cr cl hoe 
.™ | bnayrk ; ae & 


Three Related Programs for Retrieval, 
Programed Teaching, and the Taking of Note. 
. fm, 


< t 


a" 
va hore ~ 
This is 3 sketch of three closely rd atedtypes 


of programs that I think should be written, in at least crude 


4 


form, for high-speed machines with tape drives and some Sort 


of mxxk on-line output and input. For logical simplicity I 
simple mashing (€ *J., 2 


will assumge the use of a Packgrd Belli 250 with 
4 typewriter for both | 


<orrd—em Brexowettrer/output andx input// Howevels it Quid be 


ard a couple © mrrnaic Tape 
evident that kax economies of scale for some of the functions 


mentioned below will not appear until larger machines can service 


many stations. 


There are Several 


1. Prekiminary\points. 


| , 
‘ fis wal Px Go HOPED 
sal ae de igihs sing ie peat ee 


ans to sibel Te ban are 


lo 


by w- 9 ton, » WQDW - Atha toy Cau Le ; 
OA _2 betta th or od vs a cotenories,, “cals 


om = Ye rng 
ide «NTE i i O2s0| sei 
OY ha Vv ~ ov 

WF have % le ae ten ” 


Fed, 
,  ¢ Le eb ont 
Pras i» el a: tig or oj of ratio reg 


by a code 


oft ae i rn tg 


The cat Nes Wary ove thes, Ay Ye te, Cry 
i chehge Oh OndMIndhor a the (Pons 1h the 
6 OnOLie . "ROVEY Vou a caper re 
K ) Prong 010 punny 


al 5 haw as} ries, ania eo 
Leste ce yess 
Ce Bic, Tes eax ote, 


er creche == NRE eae al 


HSL 


~ | Bloons CO ome from. | 1 WD be Trig , 
y mete au be reqoeoe {he madling. ux 
ee hon . My “of cont eats. a CORNY 
a8 sg fae {hx con nel : es pe col heg 1 Oy er 
© ] Omani lest ai ™ te) V La asl ede 
# ene 
a a OAT i va ir Q a ges lah de 
Ee £ Heel prowl Ae hip on ih it alent 
San} & toc « wow. be wel . hove 
aR 5 ate of the Ale, ie Serre and chy, Ne es ee why Pras 
FD sca 166 yevanoon Ratt mo 6 eh 


Se Shaye ih (fer Neakuy. dforar—o Poe 
wget ~ ie <i ssbt}e ith mu Ve cemaiss 


tine” yropelhios @ {helt cur a ar a ; 
hy ms i re > yt pr ope proper a 


zt von el Lay , Gree ye le as 
A Yo 


‘Boy vasevale? Je Lydssapye ™ a) [Rory jon st 


L apntion’ Sa ‘of Jse ve ca fghe Reie = ee 


Aesara ei = 
ade 


Sa ey ae er Nis oo a i 3 nh 


nc swells 
Fe "bi tokos 8 b¢lly aed per t at Seo In a document... 


| V 
iy bars. rn J WSBT (OL [EP EV> ; as 
(IBM te Buln uth te San f an "i res, 204 
Why oueyones remacr Sal] el) re ane "pb ee Pie we (4 


4 ova] — are” B/uroy s MK concaval ¢ rhage | We vsblece 
(he wos doy Khich chen! WH. ho bisa] py ae 


c 
of sei ise rn os : 


“a 


Easy: mk Po ees 
| mookvel 
ae Tel te Ve cas te: 
th myn cyte Bn bol 3 te 
Pre Yor wn ges shod 2 rhe ahha 
dich bo webs ae Yodotas, ant dicilas ax peesible 
ros were pdfor al Tat 6 > Sodetf hay 
\WAN heat an, LOW ee ete ee yes pon « 
see fos — 
ie ae — 
“tig 
OVE TS 
oy (2s 
ae ioe Riis eget rahe US L, he 
aly the. peeahe luarl exfviece 
Xho Sido £6 
tee oh foresee ne | had : fo fel Yo 
ee eee wane wire ia 8 Rt CAB, es ame laa 
r Visewss (YW fp sre epatig tory a a ae 
papel beglly 4S tg lle fo 4, tal corn 
Spetitie thvgs Yo a tne ps ae he ia oY mae a's 
heyens bee wer" S ee Tn notyhar, Bras Catk © of 
PES a AY te St ech tes 


Ke erage lot 


amet rest 9 att terms Tiling \ wee] 
Seg els eee Tho me lh os | eee ) 


Ye affematve fesarlel_ fore has low, aking cra, 


the easy - ei tholfiple Men me 


- proyrumanod rrr bet ape ot ry pelo, 
Aer se a mm A ae yee Lh any 
tk » ayornd cout, Sut, & rogram maeR he 
ho ae sompicafed Hou a reahing lif SAT net funlel 
Moy Hlewble because Th ch ke Spec braushek boy af 
doles ELS, ona eves. For Yhermo re, 


si CW Le poner yevwseh a5 fie | 
Ne pr? pridjer ( Rae 7 


on cron 


4 peta 


: , ail cheapo 
ra ~ Yor ak eit ‘is a 


3.4 Fre ra fr akg mites on tbe, adn 7 
ah Yat a a 1S in = 
hwy — compiler, 3 


tow Ls se Sslore ata f° cae 
# ae wh Udes an OW) caer OK AL 


bbs z k f whoa 
wht hm 4) ul rth sina tye a ig a 


aston 2.) 


Dixsugsiol, Ths ail Le & OR \o* shod 
| Nab ere’s, ad Saree cer, atororica| moans af sled zing 
Shey i e vead, 40d dor dost Loe (e\neuy aud om Aha, 


“dim Wma worelas oul ly a scent ey pay 
8 eho, 


CENERL RENURCS. tresrerteratet 
A donbwBen, 4 Yous — es sr ‘ol hucke,” af 


re mw GA 8 vert the automation of 
ae Biba, @ ve 


Ybs conn 4 Tor wpe VoL Qn. cool huge 
‘Ye ahh eB Fe ym 
AW ox ai “ il Oe a 


de iloat R ar 


earn € Pa! (Vho L( & 
Sag, tn an pee 3 —- 


ee ae uote lore 
eer, rae, 


Tease Tee | quan sa (deck 
4s nee lev ae © 2G, t vite 
+ ey tool Kev ob ele. 
SH Sforuation yA rion at 
no , | 
Pye et s| las ah vhegp vides Em ark: ber 
ars of ptotesrorl aK e eles Ury pe 


Yhe 
es, mera wT, olf ple hos fim, Yo ie Ow se 


: K aenst ae we 
“site wast ny aes could wd ebifers. 
as cocp 40 ne ? Co ol foe yen 


f 
KA per ALC adfles oes ere i 

DX ars Ne riee 

WES S ry it Alor esearsvous 

wo Glaet_ fae ine atovials eX 
oballov Rese al Yt a! 
A bok ledlibn. gory 4 wool also 
/ aaa hg Ova a basa fecal ng 
wy —~ ~[euflay mayer als, OF 

ie Vesna, GE or iwnod 


i retwiat epliins for ae 
vor 9 ms to Fu ies lear payses 
[ter Neh, is rom ie 8 7282 | 
7 Niko. ) - el Wisc 
such ws 


lal Nas Yar Wore 

per she aid pe haps wold FEN 
‘ 7 “ft acs + coo ks ILOVel/ 
ee ¥ rf sm nt pes ble than Selb {hap ‘ 


evi J, “a cn 
:. (3 ¥ Plame 


a rssh Je Vani if pel 

/ Seed would probably 9) a 
age se veep Oe a He nena problenss 
PY 


oducdl i a N hore Wwisu eal pegs 


inpdhelee mA rushes are dl, swt. as 
Puli eres ae uly hae oe 
Y. ys a wll palevahigaee asvet 


QW i 

ig ht Set Clore Soe onkgrbed stl have om a sTodant, 
ce ps ene Who te builbso we ek, e i oo oth 
hrs “Sah Yo ‘achieve ers 40 


Po oti HP wenally by poo 


( 


prog ats wear 


Le vt fer ah laberafed 


le 


no weal faders hi apptoaelas 
| ater Ye oxphasic here 15 eyolifronayy . 
The hea Pan al nate arth 
ng aap oo fo beng 


Go Skeet WoO (Y) 


